| 1 |
A Hybrid Method for Opinion Finding Task (KUNLP at TREC 2008 Blog Track)
|
|
|
|
In: DTIC (2008)
|
|
BASE
|
|
Show details
|
|
|
| 2 |
TREC 2008 at the University at Buffalo: Legal and Blog Track
|
|
|
|
In: DTIC (2008)
|
|
BASE
|
|
Show details
|
|
|
| 4 |
KLE at TREC 2008 Blog Track: Blog Post and Feed Retrieval
|
|
|
|
In: DTIC (2008)
|
|
BASE
|
|
Show details
|
|
|
| 6 |
Applying A Formal Language of Command and Control For Interoperability Between Systems
|
|
|
|
In: DTIC (2008)
|
|
BASE
|
|
Show details
|
|
|
| 7 |
Automating Convoy Training Assessment to Improve Soldier Performance
|
|
|
|
In: DTIC (2008)
|
|
BASE
|
|
Show details
|
|
|
| 8 |
Barriers, Bridges, and Progress in Cognitive Modeling for Military Applications
|
|
|
|
In: DTIC (2008)
|
|
BASE
|
|
Show details
|
|
|
| 9 |
Odds of Successful Transfer of Low-level Concepts: A Key Metric for Bidirectional Speech-to-Speech Machine Translation in DARPA's TRANSTAC Program
|
|
|
|
In: DTIC (2008)
|
|
Abstract:
The Spoken Language Communication and Translation System for Tactical Use (TRANSTAC) program is a Defense Advanced Research Agency (DARPA) program to create bidirectional speech-to-speech machine translation (MT) that will allow U.S. Soldiers and Marines, speaking only English, to communicate, in tactical situations, with civilian populations who speak only other languages (for example, Iraqi Arabic). A key metric for the program is the odds of successfully transferring low-level concepts, defined as the source-language content words. The National Institute of Standards and Technology (NIST) has now carried out two large-scale evaluations of TRANSTAC systems, using that metric. In this paper we discuss the merits of that metric. It has proven to be quite informative. We describe exactly how we defined this metric and how we obtained values for it from panels of bilingual judges--allowing others to do what we have done. We compare results on this metric to results on Likert-type judgments of semantic adequacy, from the same panels of bilingual judges, as well as to a suite of typical automated MT metrics (BLEU, TER, METEOR). ; Presented at the International Conference Language Resources and Evaluation (LREC) (6th) held in Marrakech, Morocco on 28-30 May 2008. Published in the Proceedings of the International Conference Language Resources and Evaluation (LREC) (6th), 2008. The original document contains color images.
|
|
Keyword:
*MACHINE TRANSLATION; *SEMANTIC ADEQUACY; *SPEECH; *SPEECH TO SPEECH TRANSLATION; CONTENT WORDS; Linguistics; METRICS; SEMANTICS; SOURCE LANGUAGE; SYMPOSIA; TARGET LANGUAGE; Voice Communications; WORDS(LANGUAGE)
|
|
URL: http://oai.dtic.mil/oai/oai?&verb=getRecord&metadataPrefix=html&identifier=ADA519222
http://www.dtic.mil/docs/citations/ADA519222
|
|
BASE
|
|
Hide details
|
|
|
| 11 |
Integrating a Natural Language Message Pre-Processor with UIMA
|
|
|
|
In: DTIC (2008)
|
|
BASE
|
|
Show details
|
|
|
| 12 |
CSIR at TREC 2008 Expert Search Task: Modeling Expert Evidence in Expert Search
|
|
|
|
In: DTIC (2008)
|
|
BASE
|
|
Show details
|
|
|
| 13 |
Support for the Annual Meeting (30th) of the Cognitive Science Society
|
|
|
|
In: DTIC (2008)
|
|
BASE
|
|
Show details
|
|
|
| 14 |
Laboratory for Computational Cultural Dynamics
|
|
|
|
In: DTIC (2008)
|
|
BASE
|
|
Show details
|
|
|
| 16 |
Natural Language Dialogue Architectures for Tactical Questioning Characters
|
|
|
|
In: DTIC (2008)
|
|
BASE
|
|
Show details
|
|
|
| 20 |
Empirical Properties of Multilingual Phone-To-Word Transduction
|
|
|
|
In: DTIC (2008)
|
|
BASE
|
|
Show details
|
|
|
|
|
